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ABSTRACT 

The adequacy of using a combination of 
criterion-scaled non'- school variables to predict achievement score 
means of schools Is dincussed, Non^school data gathered on 
eighth-grade students were criterion-scaledf using the total score of 
the Metropolitan Achievement Test* Eight non* school category scores 
and actual achievement scores of selected schools were 
intercor related. A stepwise regression analysis yielded a multiple 
correlation of *949 between predicted and actual scores. Further 
steps^ including a quasi cross-validation study, confirmed the 
feasibility of the method. Results suggested that the technique could 
lead to a eatlsf actcry accountability model, could direct educators 
to focus efforts on non^school variables, and could justify 
concentration on neglected goals. (For related document, see TM 002 
508.) (Author) 
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INTRODUCTION 

Om of the chief usas of standardized tests over the yeare 
has been to make Judgaments about the initructlonaj program of 
©dueatlonal units* Usually thlfi JudgeTOnf process Involved a 
eofflparlson of the swr© of a given unit n question with that 
of some othar unit or group of units. TradltlOTal comparison 
units havi been the natlwal standardization san^lej, and regional, 
state, or local student popMlatlons, or san^les of those populations. 
The main aisufnptlon underlying these compart>sons was that dffferenees 
In the Instructional program among units could be thereby discerned* 
Comparison among local units was thought to be more fair than eoffi* 
parlson of distant units In view of the likelihood of fewer eKtraneous 
varlabiis Influttncing the scoresj howavsr, large differances •xlstfng 
among sciiool units within a rastrlcted geographfcaj location Indicated 
that other varfabl#s than the InstructlontI program may hava bean 
pesponslbl© for some of the variant. These variables have usually 
been classified under the ganerti heading of socio-economic and have 
been explored extensively In research cunducted to determine correlates 
of achlevemant) 

It has been evident that Judgements regarding the Instructional 
program could not ba made through comparison of school unit scores 
until these factors wuld be held constant. Some of the major 
studies Involving the ability of tho s^TO I and/or eomunlty to 
explain variance In achlewment have been conducted by E.L. Thorndlke, 
I940j Davanport and te-JiiBfW, ,I9S0| R.L. Thefndike, 1951, Lennon, I952| 
eawkoy,kl, I956| Mollenkopf and Melville, l9Sfi| Barnes, igfiZj Flanagan, 
l,962| Colaman, Campbalb Hobston, MsPart.land, Mood, Welnfeld and York, 
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1966; Mayeske, WIgler, Beaton, Welnfeld, Cohen. Okadi, Prosher, 
and Tabler, 1969; Hogan, 1970. In general the variables most 
predictive of school achievement were the educational level of 
adults and the economic status of the community, Hogan 's analysis 
of major stud lei Indicated that the optimum mu I tip la correlations 
between school and community variables and cognitlvely oriented 
standardized tests was about .70. He also suggested that school- 
related variables saamad to have less j-elatlonship to test scoras 
than did communfty variables. This observation ' was stated more 
emphatically by Colaman and others in the study Equality of Educational 
Opportunltv which Is eomnttniv called the Coleman Report (1966). 

Attempts to separate out the Influence of sehoof variables from 
community variables have not met with much sucwss. Perhaps the 
most succassful attempt was made in an off N;;e of Education Report 
by Mayeske and others, 1969;;/ , In this est udy a special .method 
of correlational analysis was used for siparatlng school and non-school 
variance; however, no clear sepiratlon was effected. The study dJd 
evidance that there was a TOderate correlation (.64) between s^mI 
factors and achievement In the very first part of first grade before 
school eould have had sizable Influence. Data such as this led the ' 
Investigator to narrow his study of achlevoment to non-school factors 
only, for It appeared that variables In the community seemed to actount 
for the school factors as well as the student body yarlablts. Another 
major factor which resulted In the present focus on non-school correlates 
of achievement was the eMistenM of criterion scaling, a msthodology 
for scaling nominal, ordinal and Interval data. The purpose of the 
study was to devise a non-sehool oriented Instrument which could 
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effectlvely predict stafidardlzed achievement rr»ans of groups as 
small as 30 In number. 
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METHOD 



Sitting an^ Sybjects 

Fifteen schools In East Tennessee mre selected on the basis 
of diversity of neighborhood c^aracterl sties, as this was mrm 
fmpor+ant to the pi lot study than wm the ^neralfzabl lity of the 
rtiul'te. Subjects were eighth gra^ stydents trhm classei containing 
at least 25 students* who had taKen the »iTp|©te battery of the 1970 
Metropolitan Achlevemant Test Cthe eriterlw var|lab!e) In the fall 
of 1970, 

©pnstruetlw oV the Non-School Factor Quest fonnail re 

To obtain p rid tet^r variables* forty^-tw© Itlims wene selected 
from the U.S, OfflM of Education report Eguallt}/ of Education 
Opportunity, Items nepresentlpg non-school Inf ijiiences were selected 
' on a face validity baslss and also m their ibH|lty to differentiate 
In regard to achlewment, to be explained later.: External verification 
of Tennessee student responses on the Coleman ra^^orr showed an average 
of 93.4 perMnt agneement for many of fhm If mm u the present study, 
suggesting high accuracy of response. 

The Assignment of Predictor I teM to Categories 

Categories l^ntlfJed In the natl«sj studltes by Mayeske <I969) 
which were used In the ^nes^int study werej e>^#dtatIon for tK^llenw; 
socIo-eTOnMilc status, a^ttude toward llfe^ fartl ly itru^ture and 
stability, iduMtldnar dill res and plans, race, iretd^n^ at home and seK. 

The Achleyement Test Criterion Variable 

The tcrhal Metroporitan Achlevsen»nt Test Sc^re was cAosen to make 
the local study more edmpareble to the national Istudy by Coleman and 



othars Who used a composite of non-verbal and verbal ability, reading 
cof^rehanslon, mathematics achievement and general Information teits 
published by the iducatlonal Testing Servica. To make local scores 
moPB comparable with the natlwial study total raw scor« units of the 
TennessM study were converted to itandard swres with a mean of 50 
and a standard devlatlwi of 10. Procedures to obtain data comparable 
to that of the natlonnMstudy were Mndycted to determine the stability 
of the criterion scores with which the non-school factor questionnaire 
would be seeled. 

Administration of the Iristrumants 

It was not cons Ida red Imperatlvs that the non-sdiool factor 
questlonnafre be administered at the same time as the Metropolitan 
Achievement Test beet use the time factor did not seem to be Iffportant 
for the kinds of Item on the non-school factor Instrument. The 
Metropolitan was administered in the fali of 1970, while the non-school 
factor questionnaire was administered In the spring of |97|, some 
seven months later. 



RESULTS 

ProMssIng Conversion of Data 

To get the total raw scores of the ^tetropolitan Achteviiment 
Tasti missing .scores of students who mlssad up to three subtests 
were replawd with the mean subtest scores of ftm\r school. Total 
raw scores for students In the fifteen sd^iools were plotted on a 
Normal Percentl leChart with seventeen Intervals and a thirty raw-icore 
spread per Interval* Standard scores were generated with a fnean of 
50 and a standard deviation of 10. 

Production of Criterion Scale Values for the Men -School Questtonnalr© 

.; Jhe^^le values or weights for the response positions of the 
non--school questionnaire were obfalned by averaging the achlavement 
scores of students over the fifteen schools who marked a given response* 
For example^ on Table 1^ the cr Iter i on-sea le value of students who 
said their father was a technical worker was 53,525, This figure 
represents the average Ktetropolltan Achlevfiment Test total standard 
score for all students who responded to that position* All other response 
positions were given scale values In a similar manner. It was found 
that the criterion scale valtas of the Tennessee study correlated * 87 
with the criterion scale values In rhe national study. Indicating a 
seemingly reliable relationship between non-school responses and 
achieverent 

Cofflpnatlon of Critarfon Scores fop Each School for Each Item ^sponse 

The pTOportfon of itydents fn each school who responded to each 
rs^ponie position was determlntd. Then each proportion within an Item 



was cumulatively multlpllad by the «pproprlata criterlon=scala value 
prevfously obtalntd. Table I shows ho. the Item score for one school. 
50.943. was obtained for Item 7. What work doas your father do? Itel 
s^res for each Item by school were simf lirly compi led. Because the 
crfterlon-scale value Is anstant. any different In Item scores over 
schools I, a function of the proporflon of students marking the response 
position, 

Obtaining of Catagory Swres from Item Scores 

Category scores with one exception mm mm\y averagas of the 

Item scorss btlqnging to them. The exception Involved the SES category 
where some Items wens not consldemd as vaiuable as others, end their 
average was considered as one Item s a re when the category score was 
calcujated. The result of this pr^cedu^ was a sat of eight cal^gory 
scores for each school as shown on Table 2. The actual achievement 
«eans were compI led and added to Table 2 because they were necessary to 
genarats a correlation matrix, for regression analysis. 

Performance of a Step-Wise Rogresslon Analysis 

The figures on Table 2. e.«pt for the last two rows, were used 
to produce the correlation matrix on Table 3. The correlation co- 
.fffolants in Table 3 and ^ta on the^boftom of Table 2 were Introduced. 
Into i)tep.wlse negresslon corrputer program titled "Statistical Package 
for th« Social Sciences" (SPSS) Version of 3/13/71. The results are 
Shown on Table 4. The beta weights on Table 4 and the cntagory scores 
m Table 2 were used In the regression equation to obtain predicted 
sco^s for the fifteen schools, and the ^suits a™ shown on Tab la 5. 
Tha i«rf«lutlon batwean the predicted and actual ^ 



The Ifmlted number of ijchoels sampled prasanted a statistrcal 
problem. A multipje corrolatlon of nearly 1.00 wuld be expected, 
regerdless of data used, when the number of categorjes was high and 
the number of eases was low. Becauie of this It was decided to test 
the procedures In the study with a larger number of cases. Consequently, 
the total group of student records was sorted on a card sorter by 
itandard score, and then divided arbftrartly Into 46 classroom-sized 
groups In such a way that there was a wide distribution of group means. 
The means ranged from 35.7 to 66.3. The same procedures were used 
to develop pnedlcted scores for the 46 group study, and the essential 
data are found on Tables 6> 1, and S. 

Performance of a Ouasf Cross-Val Idatton Study 

There were obvious difficulties In obtaining a cross-vandatlon 
group when the original group had such a small number of cases. If 
the Investigator had. randomly chosen two groups of 15 schools the 
llkenhood of their being "matched" In significant ways would be 
slight. Such a problem would be less likely were there two 5 pereent • 
random sairples of schTOls statewide. 

Under the limiting oondltions of this feasibility study, the 
dtcision was made to perform a quasi crosft-val Idatlon study be reassign-. 
Ing the 1449 students Into 4S new grogps^n such a way. the students In 
any one of the original 46 groups were spread out In as many as 20 new 
school groups. This was In effect changing the characteristics of the 
units to be used In the cross-validation studyj although it was not a 
matdied sample in the classlcoi seniis, It was matched In a practlcti 
sense. For this reason the group was called a quasi cross-validation 
group. 



Tha category scores oi the quasi cross-validation group of 
46 "schTOls" were Introduced Into the regression equation of the 
original 46 group study, and the pnedL^ted scores which were generated 
are shown In Table ft with the actual scores md the differances 
between predicted and actual scores. 

The correlation of .9048 between predicted and actual scores 
was sofnawhat lower than the multiple arrelatlon of .93378 generated 
by the original 46 group regression analysis. The reason for this 
can be explained by the reduction In range of the actual school 
achlavemint scores of the quasi cross-validation group. The range 
of the orl^gtnal group was 35 to 66, rounded to whole numbers, while 
the. range of the latter group was 42 to 57, rounded to whole numbers. 
It Is well known that lower correlations can be expected with more 
homogeneous groups. 



DISCUSSION 

The Effect of Criterion Scaling on the Variance Accounted For 

Crfterion scaling Is the key to this study, for without it the 
multiple correlations probably would not be larger than those In 
the studies done since 1940 which Hogan (1970) summarized in his 
dissertation on the same general t^pic as this study. The question 
Is, then, whether criterion scaling creates spuriously high correlations, 
and consequently renders the category scores qualitatively meaningless. 

According to one critic, ths acBlIng of Independent or.pre- 
dfctor variables In terms of the d#pendent variables merely makes 
the predfctors "proxy" variables, thus guaranteerng a high mgltlple 
correlatron fn v lev/ of the fact that one is thereby using multiples 
Of the same variable to predict Itself. The question of independence, 
then, clouds the issue of whether non-school factors in the study truly 
accounf for most of the difference among schools. If criterion scaling 
maximizes the Ihear relationship between predictor and what Is predicted, 
then 'the variables so scaled may spuriousry account for most of the 
variance. Other factors, such as school factors, appear to be 
unimportant, one could say, only because of a statrstical artifact. 
The SES factor alone accounted for 93 percent of the variance, and 
when this factor Is Introduced first Into a step-wise regression 
analysis, there is very 1 1 ttle variance left in which other Important 
variables can show daserved Influence. The answer. If there Is any, 
lies in the nature of correlational methodology. Undoubtedly whatever 
Is represented by SES Is not identifiable by Its surface manifestation, 
and the relatively high Intercorreiat Ions amona categories Indicates 
that whgt#v©r is being measured by the various categories has a'certaln 
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amount of cofflmunallty. Whether this cortmuna 11 ty Is explained by 
Mimon substructural slmflarltles or by the "prexy" phenomanon must 
await further research. ■ 

Several observat I oni may be relevant to .the ;dlcu&s ion. ui©neWies 
In the nature of the so-ea I led "proxies". Ft.rst, this type of pre- 
dictor varl'ab lb yields a Multiple R of about .70 when traditional 
scales are used. This Indicates that criterion scaling alone does not 
account for at least moderate correlational relationships. Some of 
the indicators #Bch as race and sex have no i nt rim ic scalar pro- 
perties- because of their nominal nature, and other scaling methods 
used to handle thJs type of data would be expected to be less accurate. 
It «uld be, then, that the higher Mult Ip le R might be a function of 
more accurate and- relevant seal i rig. 

Another observation l-s that the responses on the non-school 
Instrumant represent no "right" or "wrong" answers, and If the student 
Is responding uniquely to mostly demographic-type items, the student's 
achievement level would seem to be an entirely unrelated phenomenon. 
If the way in which students respond to the non-school Inst rument 
nop resents a stable ralatlonship to achievement,, and It seems to, then 
the phenomenon identified in the non-school Instrument have an in- 
dependent, but perrhaps unknown Identity which may have casual char- 
acteristics, ixperimental research may, need to be conducted to determine 
whether differences In category scores represent corresponding d I f- 
farenMs In the "real" world, 

If the above cons I derations can be put aside, it remains that 
prediction of achievement from non-schooi factors was the purpose of 
the study. It seems that the relationship of, non-school factors across 



a variety of demographic "mixei" Is stabia, and that achievament can 
b© predicted on the basis of the unique proportions of that "mix" 
which local schools or units sKhiblt* Thus, schools can be ascrfbed 
an axpected score which does not predetarmine thai r actual score, 
es/en though a high multiple cor re I at I on would indicate that most of 
their actual scores would be virtually the sama as the predicted. 

ImplIcatlQns of the Study . . 

The development of a progess to produce individual lied school 
nornrm has several Implications. The process can provide a more 
equitable basis for judgements by principals^ supervisors and other 
persons who use achleverent tests for comparison; purposes. Ind! vidual 
school norfTB can enable educators to compare a school with Itself; ff 
a school Is doing about what It Is predicted to do, even though the 
score seems high or low by former standards or norms, then unnecessary 
credit or blame of school faculties can be avoided* In addition, schools 
wh I ch score *s I gn I f I cant I y h i gher or I owe r than expect© d cou I d becom© 
subjacts for study as to what in the school program may have made the 
actual mean s^re different from the predicted one* 

Another aspect of sign! ficance Involves the attention given to . 
the subject matter rep resented In standardized achievement tests. If 
further studies. confirm that the way students respond to a school pr- 
gram Is a function of the community form which they core, then arduous 
efforts within the school to alter these levels at the expense of 
other Ir^ortant goali may need re-'cons I deration. 

^ Still another aspect of significance Is the direction In which 
educat I onal energi es and resources ml ght be dl rected shou Id the study 
provide enough evidence to convince decision makers to reorder priorities; 
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Unless some breakthrough in school proarams can be effectad, the 
results of the study suggest that the Job of educators In raising 
achlevemint test scores, if such Is appropriate, may be much riore 
community-wide that simply school-wide. A possible further use of 
the non-school Instrument Is that of providing dtmographic and 
attttudlnal data which might result from an Item analysis of the 
questionnaire. Such data would be useful to administrators for eross- 
sectlonel or longitudinal studies of their schools or systems for 
program p I ann ing purposes. ■ 

The data gsnerated In producing the predicted scores may have 
some value In experimental research. While no Inferences regarding 
causation can be made on the basts of thB,,hjgh correlations found 
atnong variables, the study may provide focus for areas of rigorous 
experimental study which may render more def In I te analyses of the 
highly oorrelat Ing variables. Studies such as that of Dave (1963) • 
may provide more useful Independent varlBbles for experimental research 

^ The main use of the study may, be the dovalopment of an Individ- 
ualized norm service for schools. The pnocesa will also lend Itself 
to statewldi studies. Whi le the present study used the total achieve- 
ment score as tht dependent variable, future studies will Involve 
individual sub test scores. Although the use of subtests may result 
In the loss of some predl cf I ve abl t Ity, their use may be more infoV- 
matlve than the use of the total achievement score. 

Present research related to thip s1*udy involves a near-random 
sample of 5th and 8th grade students by school In the whole state of 
Tennessee, The non-ishoo I Instrument was shortened, and Instead of 
the.total score of the Metropo 1 1 tan being uti 11 ^ed/ separate studies 
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are being conduc+ed on II subtests. While categorY scores across 
subtests have some differences, the criterion-scale values for each 
subtest SMm to be Internally consistent with the two earlier studies 
when the scores are converted to state standard scores. 

Multiple Correlations of non-schw I factors with 8th grade 
achievement subtest scores for a 51 state-wide sample of schools 
are as follows; Word Knowledge .90- Reading, .89; Total Reading, .89; 
Language, .85; Spel I Ing, .73) Math Computation, ,80; Math Concepts, 
,80.- Math Problem Solving, .851 Math Total, .83; Science, .87; Social 
Studies, .87. 
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TABLE 1 ■ 

DATA NEEDED TO PRODUCE A CRIIERION SCORI FOR ONE SCHOOL FOR NON-SCHOOL 
QUESTIONNAIBE ITEM 7, "WHAT MOBK DOBS tOUR FATHER DO?" 



Occupaclon 



Technical 

Official 

Manager' 

SemiakiUed worker 

Salesinan 

Farm owner or 
iQ^nager 

Farm worker 

Wottoan or laborer 

Professional 

Skilled worker or 
foreman 

Don ' t know 

No response 



Proportion 
Responding* 



.0758 
.0848 
.2152 
.1758 
.0727 

.0061' 
,0030 
.0303 
.1061 

.1727 
.0394 
.0182 



Criterion-scale 
Valueb 



Product' 



53.525 
51.910 
SI. 710 
48.771 
52.913 

45.000 
43.632 
46.248 
55.851 

50.052 
44.371 . 
44.556 



4,05719 
4.40196 
11. 12799 
8.57394 
3.84677 

0.27450 
0,13089 
1.40131 
S. 92579 

8,64398 
1,74821 
0.81091 
Sum^ 50,94349 



Proportion of students In a school whose, father had a given 
occupation. 

^The average achievement score of all studenta from all schools 
who marked the given response, 

• c 

Product pf.th* proportion times crlCftElon-seale value of each 
occupational classlfldatlpn, ' 

. d ■ ' ' ■ / - • ■ ■ . - 

The sum of these products la the 1 tan criterion score for the 
school for the it«a. 
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TABLl 3 



COB^LATION MATRIX OF ALL CATEGORY SC0B18 THE ACTUAL 
■ ACHIEVEMQIT MEANS OF PICTEEN SCHOOLS* 



1. Actual achievement ,46 .70 .46 .17 .68 .34 .42 .09 

2. Ixpactatlons for 

SKcsHMGe. .48 ,42 -.19 .61 ^.12 .78 .18 

3* Soalo^eeonomie itatus ,25 ,25 ,67 ^.01 .39 .32 

4. Attitude toward Ufa ^X5 .28 .25 .57 21 

5# Family struQture and 

stabiUcy ,^05 ,69 -,06 ,60 

6# EducatlQnal desirag 

^"fPl^^« -.19 .57 .03 



7, Race 

8 , Read tng at home 

9, Sex 



•.17 .46 
-.05 



a 

Rouaded to two decimal plaeea. 



TABLE 4 

mmJIS OF THE STEP-WISE HEOSESSION PEOCEDUKE 



Coda 


Category 


Multiple 
R 


R 

Square 


ESQ 
Change 


Beta 
Weight 


h , 


Soeio-aconomlc status 


.70393 


.49351 


.49551 


3,48871 


h 




,782S0 


.61247 


.11695 


1.67479 




Educ, desires and plans. 


.87015 


.75716 


.14470 


1.32901 


h 


Sex ' 


.91870 


.84402 


.08685 


-7.26259 


h 


" F&aily struc, and scab. 


.93965 


.88294 


.03892 


-8.66254 


h 


Attituda teward life 


.94704 


,89689 


.01395 


1.85690 


h 


Expect, for excellence 


.94846 


,89957 


.00268 


-0.62743 




Reading at home 


.94889 


.90039 


.00082 
Conatant 


Oi 75895 
422.11264 




Note? Standard error of 


the residual Is 1.93. 







\ 

\ 



TABLE 5 

PMDICTED AND ACTU^ SCOBIS OF FIPIEIN SCHOOLS 



e«W«iri A 1 Actual Minus 

^^^^i Actual Predicted Predicted 



1 


SO. 383 




-0,578 


2 


47,105 




-0,934 






47.108 


2.585 


4 


42,477 


43.025 


-0,548 


5 


49.074 


49.008 


0.066 


6 


48,813 


47.613 


1.200 


7 


45.500 


45.028 


0.472 


8 


41.500 


43.354 


-1.854 


9 


42.45S 


44.776 


-2.321 


10 


44. ^lO 


43.261 


1.441 


U 


43.696 


42.774 


0.922 


12 


50. $62 


50.635 


0.227 


13 


53.842, 


54.085 


-0.243 


14 


50.149 


■ 51.022 


-0.873 


IS 


53.521 


53.189 


0.332 



was :9484l!' ^"""^ Mrrelation between, the predle ted and actual scores 



TABLE 6 



COBULATION M4TRIX OF ALL CATEGORY SCOBES AND THE ACTUAL 
ACHIE^nMNT MEANS OF FORTY-SIX GSDUPS* 







2 3 


4 


5 


6 


7 


8 


9 


1. 


Actual aahievemfent 


.87 .96 


.92 


,75 


.93 


.82 


.80 


.38 




EKpeetitiona for 


.83 


.83 


.fi7 


.85 


.74 


.76 


.41 


3, 


Socla-economie status 




.88 


.70 


.92 


.76 


.81 


.39 


4; 


Attitude toward life 






.63 


.89 


.77 


.80 


.31 




Family structura and 
stability 








.70 


.66 


.58 


.35 


6. 


Educatlanal desiraa 
and plans 










.72 


.81 


.35 


7. 


Raee 












.61 


.38 



8t Raadlng at home 
9, Sex 



.39 



Rounded to . two daeimal plaQei* 



TABLE 7 



BESULTS OP THE STEP-'MISE BEGIESSIOS PROCEDURE 
FOR FORTY-SIX GRpms 



Codm 


Category 


Multiple 

R . 


R 

Square 


BSQ 
Chmge 


Beta 
Weight 


H 


Socio-economic status 


.9647? 


.93078 


' .93078 


4.51968 


h 


Attitude toward . life 


.97379. 


.94826 


,01748 


2.89267 


h 


tmiXy struc. and stab. 


.97901 


.95846 


.01020 


3.19882 


h 


Sace 


.98116 


.96268 


.00422. 


1.26691 


h 


Iduc. desires uid plans 


,98268 


.96565 


,00297 


0.68418 


h 


Ixpectatlona . for excell> 


.98347 


.96722 


.00157 


0.75497 


h 


Reading at hone 


.98375 


.96777 


,00055 


-0.61849 


h 


Sex 


.98378 


.96783 


.00006 


-0.31413 



Comstsnt -569*41121 



Notei Standard error of tha residual la 1.636. 



TABU 8 

P^DICTED AND ACTUM. SCORES OF rai TOKTY-SIX GROOT STTOY 



Ac tual 



Actual 


Predicted 


Minus 


Seore 


Score 


Predlcti 


66.344 


70 479 




64,344 


66 000 

WW 9 WWW 


A. / AO 


63.594 


64.336 


-0,742- 


62,250 


65.645 ■ 


-3.395 


62.060 


66.617 


-4.557 


61.452 


64.410 


-2,958 


60.667 


63.014 


-2.347 


60.258 


65.647 


-5.389 


59.594 


67.718 


-8.124 


58.656 


63.497 


-4.841 


57.667 


59.880 


-2,213 


51.156 


60.781 


-3,625 


56.580 


60,401 


-3.821 


55.219 


59.265 


-4.046 


54.656 


53.956 


-1.300 


53.750 


51.421 


2.329 


53.312' 


57.183 


-3.871 


52.219 


51.215 


1,004 


51.938 


52.945 


-1.007 


50.545 


48.472 


2.073 


49,437 


46.130 


3,307 


48.697 


49,948 


-1.251 


48.151 


50.506 


-2^355 









Actual 




rUuUS 


Score , 






47.625 


43.476 


4.149 


47,531 


44,794 


2.737 


47.188 


43.842- 


3.346 


47.156 


44,813 


2.343 


<tD • OJ,i£ . 


46,630 


0.182 


46.531 


47.377 


-0.846 


46.281 


46.153 


0.128 


: 45.848 


45.546 


0.302 


45.188 


44.590 


0.598 


44.625 


43.745 


0.880 


43.758 


34.764 


. 8.994 


43.750 


44.052 


-0.302 


43.515 


39,095 


4.420 


42.424 


41.430 . 


0.994 


42.121 


39.073 


3.048 


41.156 


37.146 


4.010 


40.531 


40.034 


0,497 


40.344 


43.682 


-3.338 


39.844 


33.818 


6.026 


39,375 


39.002 


0,373 


37.812 


34.144 


3.668 


37.125 


31.217 


5.908 


35*710 


34.400 


1,310 



eaorea wa8*l9726: correction between the predicted and actual 



TABLE 9 



PREDICIBD MD ACTUM, SCORES OF THE QUASI CBDSS-V4L1DATI0H 

GHOlff , N * 46 



Actual 





<rreaicceo 


Minua 




Score 


Predicti 


57.344 


60.094 


-2.750 


56. 938 


56.556 ; 


0.382 


56.531 


56.249 


0^282 


56.188 


56.541 


"0,353 


55.969 


54,019 


1.950 


55.906 


51.630 


4.276 


55.687 


58,334 


-2.647 


55.656 


55.739 


-0,083 


55.500 


54.108 


1.392 


55.438 


55,232 


0.206 


55.281 


54.377 


0.904 


54.906 


55.068 


-0.162 


54.688 


57.258 


-2.570 


54.344 


54.609 


-0,265 


53.625 


53.391 


0.234 


52.848 


49.370 


3.478 


52. 719 


50.928 


1.791 


52.545 


49.068 


3.477 


51.970 


53.794 


-1.824 


51.812 


53.173 


-1.361 


51.667 


53.534 


-1.867 


31.303 


49.479 


1.824 


51.000 


49.231 


1.769 


50.406 


51.870 


-1.464 



Aocual 
Score 



Predicted 
Bqqwb 



Aatumi 
Minus 
Prediatad 



50.250 


49.909 


0.341 


50.000 


52.666 


-2,666 


49.750 


50.787 


-1.037 


49.688 


50.066 


-0.378 


49.250 


46.701 


2.549 


49.219 


46.350 


2,869 


48.844 


46.354 


2.490 


48 ,'7 19 


51.029 


-2.310 


44.933 


44.659 


0.274 


44.290 


45.077 


-0.787 


43.912 


42,156 . 


1.756 


43.781 


49.009 


-5.228 


43.774 


44.524 


-0.750 


43.647 


41.202 


2.445 


43.469 


42.901 


0.568 


43.281 


46.198 


-2.917 


42,667 


44,771 


-2.104 


42.419 


41.462 


0.95? 


42.323 


40.384 


1.939 


42.212 


41.540 


0.672 


42.156 


42.782 


-0.626 


41,091 


42.194 


-1.103 



^'*'onA«* =""1"*°^ ''•twean th. actual and predicted 



scores was ,9048 



ERIC 



